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abstract  fCondfHM  on . ^ 

Hie  object  of  this  study  wu  to  devdop  a valid  repUcement  for  the  difBdtf  tb'ajMtjWdn  00 


Carving  Test  presently  used  in  screening  Dentd  Laboratory  Speddist  (DLS)  cndidates.  expiilfWIlUlliRt^  of 
peroeptud  tests  was  given  to  172  prospective  DLS  students.  Dexterity  tesU  were  ^ giwn  to  a subiMple. 
Experimentd  laboratory  ratings  and  find  course  grades,  if  svalable,  were  obtained  f|tr  the  subwcts.  Testi  were 
factor  analyzed,  and  individud  and  multiple  vdfcUtycorrelatioru  were  computed,  ftv'  i ^ j 

( Hie  Chalk  Carving  Test  presently  used  in  screening  prospective  DLS  students  dnf  nBntenii'i^da  ilgjflcant 
validity  with  laboratory  ratinp  or  find  grades.  This  lack  of  rdationdiip  seems  partly  due  to  somevhat  sul^ective 
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Itm20CoatiniMd: 


MOfing  reflected  by  a low  intemter  lellabltty.  Several  of  the  experfmentaly  administered  perceptual  teala  and  • 
finger  dexterity  teat  (Peg  Tutntag)  did  oonel^  algnificantiy  with  taboratory  ratinga.  A few  peroeptud  teats  abo 
were  valid  for  predict^  DLS  final  giadea. 

The  General  Aptitude  Index  waa  significantly  relatsd  to  final  grades,  but  was  not  suhatanttaly  laltCed  to 
laboratory  ratings.  A oompodte  bassd  on  four  perceptub  teats  appeared  able  to  screen  out  about  ooalulf  of  Ihs 
15%  of  students  with  the  lowest  performance  in  DLS  couiae  laboratory  work.  Whie  the  Peg  Turning  taat  appealed 
to  make  an  independent  contribution  to  prediction  of  laboratory  ratted  this  apparatus  test  piaesnti  ooat  and  taat 
administration  problems  which  make  it  leas  attractive.  In  contrast,  the  use  of  the  Perceptual  Cortqwafte  (in  fiaoe  of 
the  Chalk  Carving  Test)  would  reduce  test  administration  time  dbout  15%,  test  scoring  time  at  1^  50%,  and  last 
material  costs  would  ato  be  reduced.  In  addition,  this  study  Indicates  that  DLS  training  attrition  ritoidd  be  knrared 
somewhat  through  utilizatiao  of  the  Ibrceptual  Ccanpaaite. 
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SCREENING  TEST  BATTERY  FOR  DENTAL  LABORATORY  SPECIALIST  COURSE: 
DEVELOPMEhTT  AND  VAUDATION 


L INTRODUCnON 

Since  the  Aii  Force  makes  a considerable 
investment  in  selecting  enlistees  for  technical 
training,  one  of  the  primary  goals  of  the  opera- 
tional testing  program  is  to  maximize  the  return 
on  training  expenses  by  predicting  and,  sub- 
sequently, selecting  enlistees  who  w81  be  as 
successful  as  possible  in  a training  program.  Otte  of 
the  longer  Air  Force  training  courses  is  the 
24-week  course  for  Dental  Laboratory  Specialist 
(DLS,  AFSC  98230),  at  the  School  of  Health  Care 
Sciences  (SHCS),  Leppard  AFB,  Texas.  This 
specialty  mainly  involves  fabricating  and  repairing 
dental  prostheses  and  appliances;  such  as  jackets, 
crowns,  bridges,  and  inlays.  Selection  of  airmen 
for  the  DLS  course  is  based  on  three  criteria: 

1.  A minimum  General  Aptitude  Index  per- 
centile of  60. 

2.  A score  of  10  or  higher  on  the  Chalk 
Carving  Test. 

3.  Normal  color  vision. 

The  General  Aptitude  Index  consists  of  the  Word 
Knowledge  and  Arithmetic  Reasoning  subtests  of 
the  Armed  Services  Vocational  Aptitude  Battery. 
This  requirement  is  employed  to  ensure  that 
students  have  adequate  academic  abflity  to  learn 
the  rruiterial  presented  in  the  course.  The  Chalk 
Carving  Test  is  a carving  dexterity  exercise  whidi 
measures  ability  in  the  psychomotor  domain.  This 
test  was  introduced  in  1963  to  ensure  that  the 
students  possess  the  dexterity  required  to  perform 
the  exercises  in  the  course.  The  Chalk  Carving  Test 
has  also  been  used  by  the  American  Dental 
Association  as  the  manual  abflities  portion  of  a 
battery  for  selection  of  dental  students.  In  recent 
years,  the  Chalk  Carving  Test  has  been  replaced  in 
civilian  use  by  the  Perceptual  Motor  Ability  Test 
(PMAT).  The  PMAT  is  a paper-and-pencil  test 
designed  to  measure  line  and  angle  discrimination, 
point  location,  block  counting,  space  relations, 
and  object  visualization  (Graham,  1972).  A 
preliminary  Air  Force  study  indicated  the  PMAT 
correlates  higher  with  end-of-course  grades  for 
Dental  Laboratory  Specialist  students  than  does 
the  Chalk  Carving  Test  (r  ^ .57  and  .48,  respec- 
tively). This  paper-and-pencil  test  also  has 
advantages  in  being  less  expensive  and  easier  to 
administer  and  score. 


Initial  plans  were  to  validate  the  PMAT  for  Ait 
Force  operational  utiiuUoii.  However,  the  PMAT 
was  utuvailaUe  because  the  American  Dental 
Aaodation  fdt  the  dansrt  of  compromise  of  the 
two  test  forms  precluded  leleaiiiig  the  test  for 
research  purposes.  Therefore,  avaflsMe  tesu  with 
content  similat  to  that  of  the  PMAT  were  selected. 
In  addition,  several  dexterity  tesu  were  included 
in  the  experimental  battery.  This  wm  done 
because  the  evidence  is  not  conclusive  that 
perceptual  tests  can  adequately  predict  dexterity. 
In  fact,  both  types  of  tests  may  make  unique 
contributions  to  prediction  of  training  perform- 
ance (see  French,  I9SI;  Harrel,  1940;  ZuUo, 
1971). 


a METHOD 

Subjects 

Airmen  selected  as  candiates  for  the  DLS 
course  in  I97S  and  1976  were  the  sut^tt 
(N-172).  Sample  I (N-114)  was  utilized  for 
f^actor  atialyds  and  iiiitial  validation  of  experi- 
mental tesu.  The  minority  of  this  group  war 
administered  dexterity  testt  in  addition  to 
perceptual  tesU.  Sample  2 (N  > 58)  wu  composed 
of  the  last  three  DLS  classes  of  1976.  This  group 
was  utilized  for  additional  validation  and  was 
administered  only  the  experimental  perceptual 
tests. 

Predicton 

Descriptions  of  the  perceptual  and  dexterity 
parts  of  the  experimental  test  battery  ate 
presented  in  Tables  1 and  2,  respectively.  The 
operational  General  Aptitude  Index  (GEN  AI)  and 
Chalk  Carving  Test  were  also  included  as 
predictors.  Under  normal  conditions,  aD  DLS 
candidates  would  have  taken  the  Chalk  Carving 
Test,  but  for  experimental  purposes,  memben  of 
several  classes  who  had  volunteered  for  the  course 
were  exempted  from  taking  the  tesu.  In  the  Chalk 
Carving  Test,  the  student  is  furnished  an  80mm 
piece  of  chalk,  a knife,  and  sandpaper  and  is  given 
1 hour  to  carve  the  chalk  evenly  and  smoothly  to 
the  dimensions  and  shape  specified  in  the 
instructions.  The  score  range  is  from  1 to  20  with 
five  subscores,  one  for  overall  appearance  and  the 
rest  for  preciseness  of  dimensions. 
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Tabk  J.  Dctcriptioii  of  Expcrimratal 
Tot  Boltcry  - Peroeptiiif  Tati 


1.  Block  Coimtiiig  - this  test  requiret  the 
exuninee  to  “tee  into"  a 3-dimentional  pile  of 
blocks  and  determine  how  many  pieces  are 
touched  by  a certain  numbered  bl^.  This  Ud 
is  divided  into  two  sections  of  45  items  each, 
with  a time  limit  of  4 minutes  per  sectioa 

2.  Point  Dietance  - this  test  requires  the  examinee 
to  compare  small  distances  rapidly.  Each  item 
has  a miuked  central  point  surrounded  by  lines 
and  drdet,  among  which  there  is  a dot  niarked 
“a”  and  “b.”  The  examinee  mutt  quickly 
decide  which  of  the  two  lettered  dots  it  nearer 
to  the  central  point.  This  test  is  divided  into 
two  sections,  each  containing  30  items  with  a 
maximum  time  Hmit  of  2 minutes  per  sectioa 

3.  Pattern  Matching  - this  test  requires  the 
examinee  to  solve  pattern  matdiing  problems. 
Each  item  has  a pattern  with  a part  of  the 
whole  misting.  The  examinee  mutt  look  at  the 
parts  under  the  pattern  and  decide  which  one 
bdongt  in  the  blank  space,  thereby  completing 
the  pattern.  This  test  cont^s  37  items  wtth  a 
time  limit  of  20  minutes. 

4.  Rotated  Blocks  - this  test  requires  the 
examinee  to  select  from  among  five  choices,  the 
block  which  is  identical  to  the  “question’' 
block.  Each  of  the  five  options  is  presented 
from  a diffeient  an^e  or  side  than  the 
“question*’  block.  This  test  has  20  items  with  a 
time  limit  of  20  minutes. 

5.  Designs  - this  test  requires  the  exminee  to 
select,  from  a number  of  parts,  those  parts 
which  will  fit  together  to  form  the  “question” 
design  correctly.  Pieces  used  for  the 
construction  may  vary  from  two  to  a maximum 
of  ten.  This  test  contaiiu  22  items  and  has  a 
tinw  limit  of  20  minutes. 


Criteria 

Performance  in  the  laboratory  portion  of  the 
course  was  deemed  to  be  the  appropriate  criterion 
on  which  to  validate  the  tests.  An  Air  Training 
Command  regulation  requires  laboratory  perform- 
ance to  be  assessed  on  a satisfactory/unsatisfactory 
basis.  To  avoid  the  psychometric  dhadvantages  of 
a dichotomous  measure  for  which  most  of  the 
subjects  are  in  the  pass  group,  an  experimental 
rating  form  was  devi^.  It  was  requested  that  the 
course  Instructor  rate  seven  performance 


TsMe  2.  Dcacsiptkw  of  ExperimcsMal 
TeM  BMety  - kbtwal  Dexterity  Teats 


1.  Mask  Mridag  - this  exercise  requites  the 
examinee  to  make  three  pettcil  marks,  working 
u fast  as  he/she  can,  in  a aeries  of  boxes.  The 
marks  to  be  made  consist  of  two  vertical  littes 
with  a 0 between  them.  The  exercise  consists  of 
one  lOaecond  practice  period  and  another 
2(Vsecond  practice  period.  The  final  part  is  a 
6D«econd  period  from  which  the  reported 
score  is  derived. 

2.  P«g  Ftodrig*  - the  examinee  is  required  to 
remove  two  pegs  from  the  upper  part  of  the 
pegboard,  one  in  each  hand,  and  place  them  in 
corrrsponding  hrdes  in  the  bottom  half.  This 
procedure  is  performed  three  timet  with  the 
examinee  working  as  rapidly  as  he/she  can  to 
remove  as  many  pegs  at  pouible  in  three 
1 S-second  time  trials.  The  reported  score  it  the 
total  number  of  pegs  successfully  irantferred  by 
the  examinee  in  the  three  periodt. 

3.  Peg  Tuning*  - the  examinee  it  required  to 
remove  one  wooden  peg  from  a hole  and.  using 
only  that  one  hand,  turn  the  peg  upside  down 
to  that  the  alternately  colored  end  will  go  into 
the  hole.  The  examinee  works  at  rapidly  at 
possible  to  turn  and  place  u many  pep  ts 
he/she  can  in  three  30^ond  time  trials.  The 
reported  score  it  the  total  number  of  pegs 
successfully  turned  and  replaced  by  the 
examinee  in  the  examinee  in  the  three  periodt. 


*T>ie  equipment  (or  thew  two  exetcitet  coniiitt  of  « 
rectangular  pegboard  divided  into  two  aectiont.  each 
section  containing  48  cydindrical  holes.  For  each 
exercise,  48  cyHndrical  pegs  are  placed  in  one  section  of 
the  pegboard. 

categories  for  each  student  on  a 7-point  rating 
scale  (Table  3).  Several  ratinp  were  obtained  for 
most  students;  therefore,  ratinp  were  converted  to 
T-scores  (mean  * 50  and  SD  » 10). 

Some  of  those  tested  did  not  pass  the  Chalk 
Carving  Test,  and  some  were  not  assigned  to  the 
DLS  course  for  other  reasons;  consequently, 
laboratory  latinp  were  available  for  137  tested 
subjects.  DLS  final  grades  also  were  used  as  a 
criterion.  These  grades  were  obtained  from 
technical  training  files  at  the  same  time  GEN  A1 
scores  were  obtained  from  the  Processing  and 
Classification  of  Enlistees  (PACE)  files.  These  files 
are  maintained  by  the  Computational  Sciences 
Division  of  the  Air  Force  Human  Resources 
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TibkJ.  Pcrfonmaoe  CaUgofta 
for  Laboratory  iirtaii 


Each  itudent  is  ratad  on  a seals  of  I to  7 for  each 
of  theae  cate^orias: 

A.  How  much  work  can  the  studant 
accomplish? 

B.  How  good  is  the  quality  of  the  student's 
work? 

C.  How  accurate  is  the  student  in  hWher  irork? 

D.  How  much  does  the  student  know  about 
his/her  work? 

E.  How  much  aptitude  or  facility  does  the 
student  have  for  this  kind  of  work? 

F.  How  resourceful  is  the  student  when 
something  new  comes  up  or  something  out 
of  ordinary  occun? 

G.  Conddering  all  the  factors  already  rated, 
how  accepuble  is  the  student’s  work 
(his/her  sU-around  abflity  to  do  the  Job)? 

Sale 

1.  Unsatisfactory  - Dismissed  from  the 
training  program. 

2.  Poor  - Deficient  in  many  areas. 

3.  Below  Average  - Work  usually  meets 
acceptable  standards. 

4.  Average  - Woric  is  of  acceptable  quality. 

5.  Above  Avera^  - Work  is  of  acceptable 
quality  and  occasionally  demomtrates  a high 
degree  of  proficiency. 

6.  Very  Good  - Performance  is  usually  of  high 
quality. 

7.  Excellent  - Unusually  proficient  in  his/her 
work. 


Laboratory,  Brodu  AFB,  Texas.  Ihese  data  were 
not  available  for  the  last  DLS  class  since  they  were 
requested  prior  to  its  graduation  date.  Data  for 
some  studmts  were  not  available  in  technical 
training  and/or  PACE  files.  Fitud  grades  and  GEN 
AI  scores  were  available  (in  common)  for  95 
sul^cts. 

Sutiatical  Methods 

A principal  components  factor  analysis  was 
accomplished  for  the  predictor  variaUes.  Multiple 


correlation  analyses  were  employed  to  obtain 
estimates  for  the  utMiiy  of  the  tesu  in  predicting 
criterion  performance. 


UL  RESULTS  AND  DISeUWON 

Means,  standard  deviatioru,  and  inlcrcorrela- 
tioiu  for  predictoa  ate  listed  in  Tables  A2  and  A3 
of  Appendix  A.  Vabdities  of  predicton  for  sample 
1 ate  presented  in  Table  4.  With  laboratory  ratii^ 
as  the  criterion,  only  two  experimental  tests 
correlated  significantly  (Le.,  Routed  Bk>cks  and 
Peg  Turning).  One  other  perceptual  test  had 
near-iifnifkant  validity  (DeRgns,  p lets  than  .10). 
Againat  DLS  final  gr^e,  only  intern  Matching 
and  Rotated  Blocks  demonstrated  significant 
validity.  Neither  operational  selection  test  corre- 
lated with  laboratory  ratingt.  but  the  GEN  AI  was 
valid  for  prediction  of  final  grades.  Explanationt 
for  the  lack  of  validity  of  the  Chalk  Caaeing  Test 
were  sought  The  effect  of  pre-screening  was 
partiaOy  tested  by  comparing  laboratory  rstingi  of 
thoee  passing  the  Chalk  Carving  Teat  with  ratings 
of  those  not  taking  the  test.  If  the  selection  test  is 
valid,  thoae  not  screened  should  perform  len  wdl 
on  the  criterion.  Virtually  no  difference  was  found 
between  laboratory  ratinp  of  these  two  poups. 
The  degree  of  subjectivity  in  scoring  the  Ch^ 
Carving  Test  was  examined.  Pieces  of  chalk  for  55 
airmen  tested  at  Lackland  AFB,  Texas,  were  tent 
to  the  School  of  Health  Care  Sciences  at  Sheppard 
AFB,  Texas,  for  independent  scoring  by  quRified 
raters.  The  correlation  between  the  two  teu  of 
scores  was  only  .28.  This  indicates  that  low  inter- 
rater  reliability  may  account  for  the  lack  of 
validity  in  this  study  for  the  Chalk  Carvitrg  Test.  In 
comparison,  test-retest  reliabilitiet  obtained  for 
perc^ual  tests  at  reported  elsewhere  (Guinn, 
Tupet,  A Alley,  1970)  ranged  from  .90  for  Block 
Counting  to  .73  for  Point  Distance. 

Validities  of  avaflaUe  predicton  for  sample  2 
are  also  diown  in  Table  4.  The  results  for  the 
perceptual  tests  were  somewhat  better,  but  due  to 
the  smaller  sample  size,  only  two  experimental 
tests  correlated  significantly  with  laboratory 
ratings.  The  GEN  AI  wu  valid  for  prediction  of 
final  grades. 

Predictor  validitiet  for  combined  samples  are 
presented  in  Table  5.  Four  of  the  perceptual  tests 
correlated  signiHcantly  with  laboratory  ratings, 
and  three  of  them  correlated  significantly  with 
final  gradea  The  GEN  AI  wu  again  valid  with  final 
grades  u the  criterion,  but  not  with  laboratory 
grades. 
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armiwr 

rr-^ — 

am 

leHi 

am 

■etaa 

a« 

MMS 

aw 

■Mta 

m 

r 

It 

r 

M 

r 

N 

f 

Hock  Counting 

79 

.15 

58 

32* 

62 

-.10 

33 

.26 

Point  Distance 

79 

.09 

58 

35** 

62 

-.01 

33 

-.09 

Pattern  Matching 

79 

.14 

58 

.20 

62 

36** 

33 

.27 

Rotated  Hocks 

79 

.22* 

58 

.24 

62 

.42** 

33 

.29 

Design 

79 

.20 

58 

.22 

62 

.20 

33 

.23 

MarkMakkv 

79 

.10 

• . 

• • 

62 

-.19 

• • 

• • 

Peg  Placing 

51 

-.02 

• • 

• • 

38 

-.10 

• • 

• • 

Peglbming 

51 

.27* 

• • 

• • 

38 

-.14 

• • 

•• 

Chalk  Carving 

54 

-.12 

• • 

• . 

48 

.17 

• • 

• • 

General  Aptitude  Index 

68 

.10 

33 

38 

62 

.42** 

33 

.47** 

*Slciiiflcant  at  .05  Icvd. 


**SigniScaM  m .01  IcwL 
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TabkS.  VdMUlwiorCoiMiiii—ltoofDtSSfdam 


- , 

ua 

rustaa 

rsMi 

One* 

N 

vaaeitv 

N 

vtaeny 

Block  Counting 

137 

.22** 

95 

.14 

Point  Distance 

137 

31* 

95 

.06 

Pattern  Matching 

137 

.15 

95 

.23* 

Rotated  Hocks 

137 

31* 

95 

.28** 

Designs 

137 

.20* 

95 

.22* 

General  Aptitude  Index 

101 

.18 

95 

.44** 

'Si^flcam  at  .05  levaL 
**SipriAcanl  at  .01  lead. 


A multiple  comlotion  (R)  wm  computed  bated 
on  an  five  perceptual  testa  (see  Table  6).  The  R 
was  signifl^t  with  both  laboratory  ratings  and 
final  grades  as  criteria.  Multiple  Rs  were  then 
computed  udng  the  four  most  valid  perceptual 
tests.  The  R with  laboratory  ratings  remained  at 
35,  and  the  R with  final  grades  dropped  insignifi- 
cantly from  .36  to  .35.  A composite  was  formed 
(bated  on  these  four  tests)  in  which  Hock 
Counting  and  Designs  were  unit-weighted.  Point 
Distance  waa  douMe-wei^ted,  and  Rotated  Mocks 
was  tri|de-weighted.  Thm  weights  were  chosen  as 
approximations  to  the  raw  score  regression 
weights.  This  Perceptual  Composite  had  significant 
validitiet  of  .32  with  laboratory  ratings  and  .24 
with  final  grades.  A drop  In  validity  it  expected 
when  compared  to  the  multiple  R,  because  of  the 
simple  wei^ting  system. 


Becauae  any  DLS  screening  test  would  be  used 
in  conjunction  with  the  GEN  Al,  multiple  Rs 
baaed  on  the  Perceptual  Composite  and  GEN  Al 
were  computed.  The  Rs  with  laboratory  ratinp 
and  final  grades  were  36  and  .49,  respectively.  For 
both  criteria,  the  addition  of  the  Peroeptud 
Composite  represented  a significant  increase  over 
that  obtained  with  the  GEN  Al  at  sole  predictor. 
Fur  the  limited  data  available  (N  ■ 51),  when  the 
^ Turning  dexterity  test  was  added  to  the 
Pemptual  Composite,  a midtiple  R of  .44  with 
laboratory  ratings  was  obtained.  This  represents  a 
significant  increase  in  prediction.  However,  this 
test,  which  is  considered  a measure  of  finger 
dexterity,  shares  several  of  the  disadvantages  of 
the  Chalk  Carving  Test.  The  apparatus  it  somewhat 
expensive  and  requires  a room  with  tablet  for 
adminittration.  In  addition,  it  mutt  be  scored  at 


Table  6.  M«MpteCotwlrtw(M>)<>rnwMMrtni 
of  TmM  for  fMdiclkNi  of  DU  CrilHto 


tea  1 

amra 

n«wi 

N 

r 

M 

f 

Five  Perceptual  Tests 

137 

JS** 

9S 

J6* 

Four  Perceptual  Tests* 

137 

JS** 

9S 

J5* 

Three  Dexterity  Teats 

SI 

JO 

43 

22 

Perceptual  Composite^ 

137 

J2** 

95 

J4* 

Perceptual  Composite  and  Peg  Ttimlng 

51 

43 

2b 

Perceptual  Composite  and  GEN  A1 

9S 

J6** 

95 

49*» 

*Doa  not  Incltad*  Paltm  Mwfhin^ 

^Corapotad  of  Block  Couailno  « 2 i Point  OlManca  o 3 ■ Botttnd  Blockt 
* Dctigni.  Cocfficknu  an  timplc  coiraiatloaa. 

'Sifolficant  at  .03  IcvaL 
**Si9iiflcaal  at  .01  lavtl. 


once  by  the  eximineit,  and  the  scoring  cannot  be 
verified  later.  UnUte  the  Perceptual  CompoaUe, 
the  Peg  Turning  test  did  not  make  a significant 
contribution  to  prediction  of  DLS  final  gradea. 

Correlational  analyses  indicate  the  degree  of 
relationahip  of  two  or  more  variables  over  the 
entile  range  of  scores  and  assume  multivailate 
normal  distributions.  The  utiHty  of  a screening 
instrument,  however,  is  often  determined  by  the 
relatioruhip  of  low  predictor  scores  to  criterion 
performance.  In  this  instance,  a cutoff  score  on 
the  ferceptual  Composite  wss  sought  below  which 
laboratory  performance  would  Iflcdy  be  marginal 


or  unsatisfactory.  Grouped  frequency  dtstributlons 
of  these  variables  sre  presented  hr  Table  7. 
Twenty>two  or  16.1%  of  the  students  had 
Perceptual  Composite  scores  of  leas  than  ISO. 
Their  average  laboratory  rating  was  42.9  compared 
to  51.5  for  those  with  Fbrceptual  CompoaitM  of 
1 SO  or  higher.  Mne  or  4a9%  of  the  22  had  Ubora- 
toiy  ratings  of  leas  than  40  (1  SD  bdow  the 
meanX  and  an  sdditiooal  18.2%  had  labontoiy 
ratingt  of  40-44.  Of  those  with  Perceptual 
Composites  of  ISO  or  more,  only  9.6%  had 
laboratory  ratings  below  40.  The  avetage 
Composite  score  for  the  19  students  whh  labora- 
tory ratings  below  40  was  158.1. 


Table?.  Comparison  of  Laboratory  Ratfaip  and  Pbreeptnal  Compel  Sooses 


Lae  luiiiis* 

rami 

ama 

ac  rune* 

N 

•Smo 

CiMiaL  N 

% 

Ul  naas* 

N 

ISwa 

CaaMI.  N 

« 

240  ft  more 

7 

54.1 

137 

100.0 

65  ft  more 

10 

20a8 

137 

100.0 

230-239 

3 

50.7 

130 

94.9 

60-64 

14 

198.9 

127 

92.7 

220-229 

5 

50.8 

127 

92.7 

55-59 

20 

192.3 

113 

82.5 

210-219 

4 

52.5 

122 

89.1 

50-54 

33 

183.1 

93 

67.9 

200-209 

21 

55.0 

118 

86.1 

45-49 

18 

170.8 

60 

43.8 

190-199 

21 

50.7 

97 

70.8 

40-44 

23 

180.5 

42 

30.7 

180-189 

14 

53.8 

76 

55.5 

35-39 

13 

154.5 

19 

13.9 

170-179 

14 

48.5 

62 

45.3 

34  ft  less 

6 

166.0 

6 

4.4 

160-169 

18 

51.1 

48 

35.0 

150-159 

8 

44.8 

30 

21.9 

140-149 

5 

42.2 

22 

16.1 

130-139 

7 

41.7 

17 

12.4 

129  ft  less 

10 

44.1 

10 

7.3 

Total 

137 

50.1 

Total 

137 

181.8 

*Can*m«d  to  T-tcore«. 
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IV.  CONCLUSIONS 

and  recommendations 

The  Chalk  Caiving  Teat  pitKntly  uaed  in 
screening  prospective  DLS  students  did  not 
denv'tutiate  signifkant  validity  with  laboratory 
ratings  or  final  grades.  This  iKk  of  relationship 
seems  partly  due  to  the  somewhat  subjective 
scoring  u reflected  by  a low  interrater  reliability 
(r»  .28).  Several  of  the  experimentally  admin- 
istered perceptual  tests  and  a Anger  dexterity  test 
(Peg  Turning)  did  correlate  significantly  with 
laboratory  ratings.  A few  perceptual  tests  also 
were  valid  for  predicting  DLS  final  grades. 

The  General  Aptitude  Index  which  Is  used  for 
academic  screening  of  DLS  candidates  wu  signiA- 
cantly  related  to  Anal  grades  (r  ■ .44),  but  was  not 
substantially  related  to  latoratory  ratings.  A 
composite,  baaed  on  four  perceptual  tesu, 
appeared  able  to  screen  out  about  one-half  of  the 
1S%  of  students  with  the  lowest  performance  in 
DLS  course  laboratory  work.  Of  the  13.9%  with 
the  lowest  laboratory  ratings,  47.4%  were  also 
among  the  16.1%  with  the  lowest  Perceptual 
Composite  scores.  While  the  Peg  Turning  test 
appeared  to  make  an  independent  contribuAon  to 


prediction  of  laboratory  ratings,  this  apparatus  test 
presents  cost  and  test  adminisiration  problems 
which  nuke  its  use  less  attractive.  In  contrast,  the 
use  of  the  Perceptual  Composite  in  place  of  the 
Chalk  Carving  Test  would  reduce  test  admin- 
istration time  about  15%,  test  scoring  tittte  at  least 
50%,  and  test  material  oostt  would  also  be 
reduced.  In  addition,  this  study  indicates  that  DLS 
training  attrition  should  be  lowered  somewhat 
through  utiliiation  of  the  Perceptual  Composite. 

It  is  recommended  that  the  Perceptual  Com- 
posite be  instituted  as  a screening  instrument  in 
place  of  the  Chalk  Carving  Test  for  selection  of 
airmen  for  DLS  training.  A cutoff  score  of  150 
appears  to  be  the  most  efAcient  minimum  require- 
ment for  selection  on  this  test. 

Due  to  the  validity  of  the  Peg  Turning  test  for 
the  limited  sample  given  this  test,  it  is  recom- 
mended that  additional  DLS  students  be 
administered  Peg  Turning  and  alto  rated  on  labora- 
tory performance.  Then,  if  Peg  Turning  continues 
to  demortstrate  useful  validity,  it  could  be  added 
to  the  Perceptual  Composite  or  replace  one  of  the 
four  subtexts  for  operational  administration  in  a 
centralized  location. 
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APPENDIX  A:  SUPPLEMENTAL  STATISTICS 


Prim  to  collection  of  criterion  d*ta.  factor  analysis  of  the  experimental  teaU  was 
accomplished  using  sample  1 data.  Three  factors  resulted  which  accounted  for  S7.4%  of 
the  total  variance  after  the  matrix  was  rotated.  Table  A1  shows  the  tests  loading  the 
highest  on  each  factor  (only  loadings  of  .3  or  more  are  given).  Factor  I is  clearly 
perceptual  in  ruture,  u Rotated  Bocks,  Designs,  Block  Counting,  and  Pattern  Matching 
all  had  loadings  of  greater  than  .7.  Factor  2 appean  to  be  dexterity.  Peg  Turning  and  Peg 
Placing  both  had  loadings  of  greater  than  .7  on  this  factor.  Factor  3 was  labeled  length 
estinution  because  Point  Distance  had  by  far  the  highest  value  on  this  factor.  Somewhat 
surprisingly,  the  Chalk  Carving  Test  was  not  high  on  the  dexterity  factor.  All  three  factors 
seemed  to  have  some  relevance  to  the  DLS  course.  All  of  the  tests  loaded  highly  on  at 
least  one.  factor. 


Table  Al.  Results  of  Factor  Analysis  of  Predictots 


Test 

Factor 

1 

a 

a 

Bock  Counting 

.75 

• 

Point  Distance 

.79 

Psttem  Matching 

.74 

Rotated  Bocks 

.79 

Designs 

.76 

Chalk  Carving 

.48 

Mark  Making 

.57 

Peg  Placing 

.71 

.42 

Peg  Turning 

.78 

Percent  of  Total  Variance 

27.3 

16.8 

13.4 

*Only  loadings  of  J or  mote  are  listed. 


Table  A2.  Mearu  and  Standard  DeviatioiK  for  DLS  Samples 


Sample  1 

SampM  a 

Maasuro 

N 

Mean 

SD 

N 

Mean 

K> 

Bock  Counting 

114 

26.11 

11.39 

58 

29.24 

9.53 

Point  Distance 

114 

27.25 

9.26 

58 

26.64 

10.38 

Pattern  Matching 

114 

27.26 

5.99 

58 

23.24 

7.30 

Rotated  Blocks 

114 

7.80 

5.13 

58 

5.03 

4.45 

Designs 

114 

65.54 

10.55 

58 

69.8& 

6.19 

Mark  Making 

114 

46.17 

6.14 

, , 

, , 

Peg  Racing 

84 

88.54 

8.53 

• . 

• . 

Peg  Turning 

84 

92.30 

9.61 

, , 

. • 

Chalk  Carving 

89 

11.40 

4.15 

, , 

. . 

, , 

General  Aptitude  Index 

68 

70.50 

9.00 

33 

74.39 

12.55 

Lab  Rating 

79 

31.71 

7.14 

58 

28.06 

7.75 

Final  Grade 

62 

80.66 

6.04 

33 

80.91 

6.12 

W>kA3.  PicdIctorlalcrcofidilkMfotConhiMdDUSMplM 


ee  mt 


Hock  Counting 

26*  24 

18 

32 

25 

35 

12 

-10 

18 

Point  DIttmoe 

06 

04 

12 

10 

09 

-09 

n 

00 

Pottem  Hitching 

62 

14 

11 

07 

-11 

06 

18 

Routed  Bocks 

12 

06 

-06 

-04 

-06 

02 

Deilpu 

26 

12 

-16 

05 

08 

Muk  Making 

21 

03 

03 

-07 

Peg  Placing 

37 

23 

07 

PeglWning 

12 

02 

Chalk  Carving 

21 

General  Aptitude  Index 

*I>*diii«b  ha**  been  omktedL 
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